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Montana  Army  National  Guard. 


<N  <N  CO 


CN  CN 


C/5 

H 

Z 

H 

H 

Z 

O 

U 


C/2  •— i 


CN 

t 


05 

< 


D 

on 

W 

> 

P 

D 

U 

a 

X 

m 


z 

o 

M 

H 

U 

D 

Q 

O 

05 

H1 

Z 


c/a 

<U 

c 

13 

C/3 

Cd 

QQ 


g  53 

E  g 

"o  X3 

§  c  53 

«<s  > 


C/3 

2 

Cd 


(U 

C/3 

O 


3 

Oh 


C  3  r2 

§  g  g 

l|l 

w  X  r- 

&>  ttj  £ 
<!  *-h  CN 


C 

w 

■o 

c 

cu 

so 

<D 

~o 

c 


S  <  OQ 


U  Q 


o 

so 

<u 

05 


x: 

H 


c 

.© 
"h— I 

.N 

‘5 

cd 

DC 

i- 

O 


i*5 

05 

O 

£ 

w 

< 

05 

Oh 

H 

Z 

u 

s 

C/2 

c/2 

W 

oo 

C/2 

< 


i/i 

Oh 

1/3 

cd 

H 


1/3 

c 

o 
•  ^ 
•4— » 

c 

(O 

> 

u- 

<D 


05 

< 

H 


C/2 

■o 

c 

cd 

C/3 

OS 

1/3 

cd 

H 


<D 

O 

C 

cd 


u. 

<U 

Oh 


1/3 

T3 
O 
X! 

H— I 
C/3  ^ 

cd  *5 
H 


&0 

S  Oh* 
cd 

cd  C 

05  < 


<  ffl  U  Q 


oo 

H 

J 

D 

on 

W 

05 


c/a 

H-H 

e 

D 


CJ  00 

3  I— I 
i£.  00 

>< 
J 
< 
z 
< 


Q 

Z  H, 

^  w 


cd 

X) 

E 

o 


CN  CO  Tt" 


Preceding  Page  Blank 


.  Performance  by  Echelon . HM 

.  Performance  by  BOS . IU-4 

.  One  Intervention  Used . HI-5 

.  Brigade  HQ  and  Armored  Task  Force . HI-5 


5.  Mechanized  Infantry  Task  Force . III-6 

6.  Combat  Element  Summary . HI-7 

.  Support  Battalion . HI-8 

1.  Pre-NTC  Training . HI-8 

2.  Baseline . HI-8 


OO  i 

i  i 

K  > 


I 

06 


o 

o 

c 

cd 

S 

Ui 

a 

u 

<D 

Oh 

cn 


03 


c/3 

Z 

O 

>— H 

C/5 

D 

J 

U 

Z 

o 

u 

Q 

Z 

< 


D 

C/3 


> 


c/a 

<U 

o 

c 

a 

04 


I 

a 


CQ 


c/a 

T3 

O 

w 

<u 


c 

o 

»  *-H 

C/3 

C/3 

<u 

u> 

60 

<D 

0* 

u. 

cd 

<u 

C 


S-, 

Cd 

Vi 

Vl 

O 

O 


<o 

c 


>> 

X3 

<U 

o 

c 

cd 


u, 

<U 

Oh 

M-h 

o 

c 

o 

VI 

•  ^ 

cd 

&. 

s 

o 

Y 


c 

0) 

Oh 

Oh 

< 


Pi 

< 

H 


C/3 

-O 

T3 

<u 

_c 

'3 


c  ^ 
o 

z 

T3 
C 
cd 


O 

Z 

"O 

c 

cd 

T5 

<U 

_C 

'3 


Vi 

M 

Vi 

cd 

H 

4h 

o 

(U 

Vi 

>> 

c 

< 


cd 

> 


03 


T3 

C 

0) 

Q. 

O, 

< 


TABLES 


m  so  g- 

00 

vo 

r- 

00 

Os 

l-H  HH  l-H 

.  .  HH 

HH 

HH 

HH 

HH 

HH 

HH 

HH 

HH 

HH 

HH 

HH 

o 


cnj  cn  rt 


g 

o 

•X3 

g 

<u 

> 

Uh 

a 

c 

HH 

04 

< 

H 


U) 

G 

O 

O H 

V-< 

O 

</) 

<D 

Q 

*g 

G 

O 

G 

o 

G 

£ 


C/3 

G 

O 

G 

G 

<D 

> 

fc-i 

a 

G 

HH 

OS 

< 

H 


C/3  00 


C/3 

G 

H 


c/3 

fc 

U 

U 

«3 

C/3 

O 

PQ 


c/3 

G 

O 

G 

G 

O 

> 

l-H 

<U 


X 

*C 

G 

s 

G 

O 

G 

G 

Q 

> 

Uc 

(0 


1/3 

> 

1/3 

G 

H 


G 

O 

ti 

o 

ou 

JD 

& 

G 

X 

w 


G 

G 

G 

G 

•a 


l-H  f-H 

04  t/J 

^  H 

H  G 

a  h 

Q  c 

S  o 

>»  G 

t  S 

1  £ 

G  Q3 

•a  z 

l-H  G 


X 

•r1 

is 

G 


<U 

O 


lH 

«s 


M 

Hi 

d) 

Pu 

0) 

:  : 

:  S3  • 

£  E 

<D  J 

i_2 

o 

Oh  Oi 

■S 

G 

G 

G 

G 

<U 

G 

■a 


C/3 

C/3 

G 

H 

G 

O 

VO 

Os 

u 

H 

Z 

G 

G 

G 

OO 

OS 

U 

H 

Z 

G 

<D 

O 


<U 

Oh 


G 

H 

00 

w 

G 

G 

t>0 

"C 

PQ 


<o 

o 


€ 

<u 

PP 

o 

o 

Ih 

o 

frl 

-X 

c/3 

G 

H 


<D  < 

a  h 

o  a 

Ph  g 

c/3 

C/3 

H  G 

G  G 
G  <U 
G  G 

u  ’a 

G  >H 
G  E“ 1 
00 

*G  o 
PQ  Z 


G 

O 

’a3 

•g 

W 

>s 

G 

"5 

PX  „ 

c/3  OO 
G  OS 

H  U 


o 

G 

G 

G 

•a 

£ 

04 


o  „ 
W  C/3 

>>  G 
G  O 

§  g 


H 

Z 

G 

(O 

O 


<L> 

Oh 

G 

O 

O 
■*— > 
cd 
» 1 1  < 

0h 

> 

Ph 

PQ 


o 

*t3  't!  G 

O  O  c 

Oh  Oh  G 

u  u  ** 

H  H  g 

Z  Z  H 


cn 

G" 

>n 

vo 

HH 

HH 

HH 

1 

HH 

HH 

HH 

1 

HH 

HH 

HH 

1 

HH 

HH 

HH 

III-7.  Tank  and  BFV  Platoon  Performance  at  NTC98  on  Tasks  Trained  and 

Not  Trained  by  SIMITAR . Ill- 15 


Ill- 8.  Tank  and  BFV  Platoon  Performance  on  SIMITAR  Trainable  Tasks  at  NTC98  and  AT97 .  Ill- 16 

III-9.  Brigade  Performance  on  SIMITAR  Trainable  Tasks  by  Battlefield 

Operating  System  (BOS) . Ill- 17 

III- 10.  Armored  Task  Force  Performance  on  SIMITAR  Trainable  Tasks  by 

Battlefield  Operating  System  (BOS) . Ill- 18 


I 


p 

co 

W 

> 

HH 

H 

P 

P 

w 

X 

H 


3  Oh 

/~c  <2 

03  S 

e  2 


o 

£ 


I 

Wh  03 

<y  ss 


X 

3 

00 

03 

03 

C2 

•5 

X 

03 

O 

3 
•  ^ 

3 

C/2 

3 

G 

> 

<U 

X 

c3 

< 

W) 

t-H 

,0 

e 

C+-H 

3 

60 

•  PH 

cd 

3 

« 

3 

■*—3 

•a 

j— ( 

G 

s- 

H 

c2 

3 

c+-< 

0 

OS 

3 

0 

< 

0 

x 

S 

d 

*3 

■*— > 

X 

■»-> 

O 


03 

XI  os 
-  < 

£  fc 

f  § 

^  oo 


t:  £ 

2  2  oo 

g*  >  Os 

O-i  o 

3 


C/3 

<u 

o 


u 
s  fc 

<u  Z 

3  h_> 

CT  3 
<D 


£  1 

-  g 
cx  '§L 

^  5/3 

H  03 

M  > 

S  o 

S3  £ 


O  ^-N 

-  g 

03  X/ 
(U  ON 

C 

03  cs 

->  -2 

o  <3 

,<u  X 

%  § 

S  u 


(75 

o  X> 

00  G 

C/2 

i  - 

E=2 

O  —  ~ 

U  x  g 

w  (U  o 


l-( 

03 

> 

3 

<D 

C 

3 


C/3  03 
C/3  ‘ 

u 


X 

3 


> 

o  cu 

°  4^ 

o 


5 


c 

o 

X 

3 

N 


O 

h-j 

3 

=  (U 

■>  £ 

>  co 

-  <D 

*-H  C/2 

D  C/2 


> 

3 

03 

3 

3 


3 


f  S? 


L.s 

~ 

f  P/ 

Jh— i  C 
<4-(  3 

3  & 


X 

03 


3 


3 

t-i 

H 


O  3 

3 
O 
X 
3 
3 

"3 

> 

1) 


5  GO 


>T 

v- 
03  0) 

3 
3 
3 


3 


3 
3 
O 
X 
3 

2  z 


00 

ON 

U 

H 

Z 


co  03" 
C/3  3 

CO  2 


S  60 

3  c 

DO  '3 

2  ■£ 
Oh  X 


CO 

W 

z 


3  £ 

W 
co 

< 
CO 


Q 

Z 

♦n 

co 

* 

CO 

< 

H 


x 

3 

3 


03 

3 

£ 

03 

03 

t-i 

3 

O 

o 

x 

03 

C/3 

3 

X 

1 

V-c 

0) 


3  43 

X  ^ 

3  *H 

O  3 

X  g 

ffl  3 

*rt 

3  .2 

3  X 

60  * 
3  t+H 
•S  O 
3 

•g  3 

£  2 
t-H 

^  w 

>N  Oh 


60  X 

£  g 

X  w 
3  1 

ti  d 
60  >3 
1  >  G 
G  bG 

•  *h 

a-s 


Oh  S 

£  < 


o 

o 


c/i 

0) 

O 

> 

1) 

x 

3 

_o 

'X 

3 

£ 

cc 


C/3 

3 

O 

X 

g 

£: 

03 


C/3 

3 

O 


Oh 

w 

H 

CX 

< 

£ 

o 


o 

t— 

4 

03 

> 

o 

c/T 

X 

03 

3 


03 

O 

g 

£ 


3 

£ 

3 

x  3 

t-H 

03 
Oh 


rn 

CO 

0 

03 

X 

>T 

g 

03 

03 

■5 

X 

^3 

03 

X 

H— * 

*o 

3 

60 

>*— » 
GC 

3 

■H 

C/2 

3 

C/2 

G 

C/2 

Ui 

•*— < 

p22 

0 

to 

c 

0) 

f5 

0 

0 

X 

u-l 

03 

<u 

3 

> 

Vh 

‘3 

0 

t-H 

H-H 

C/2 

O 

3 

3 

O 

o 

CO 


X 

_03 

3H 

g- 


ir, 

X 


tn 

o 

£ 


03 

t-H 

3 

X  /'”N 

t)  g 

-  —H  *— 

X  3 
^  Oh 


C/3  ^-, 

u  D 

x 

3 
3 


C/3 

X 

C/3 

3 


3 

3 


60 

3 

3 

*a 


O 

u 

H 

Z 

X 

X 

2 

3 

Uh 

C/3 

C^ 


03 

O 

4-» 

o 

3 

l-H 

0h 

X 

03 

03 

Z 


C/3 

3 
O 

o 

H-J 

x  ^2 
.2  & 
X  r-v 

^  .2 

o  x 

“  ^ 

DO 
3 

-  *rt 
1/5 

X  33 

ie  M 
3  fc 

1  ir 

03  X 

X  g 

8® 

3  > 

?! 
X  •§ 

3 

X 
3 
3 


03 


X 

C/3 

3 


X 

3 

»N 

cn 

3 

> 

G 

#o 

s 

Z 

0 

’co 

0 

O 

03 

03 

Hi— » 

1 

C/2 

*-> 

03 

H 

03 

3 

1 

C/2 

S 

1 

03 

g 

Z 

w 

> 

OS 

OS 

fS 

HH 

0) 

•  H 
60 
03 

■4— > 

G 

Uh 

•4—3 

CO 

& 

s 

03 

H 

5 

£ 

H 

00 

W) 

£ 

3 

t-H 

60 

O 

Z 

pp 

C 

3 

Oh 

2 

• 

•3 

2 

O 

t-H 

Oh 

03 

|  ^ 

o  § 
X  3 
3 

S  2 

x  C 

X  r  , 


03 

X 


I 


60  X  S 


C/3 

03 


3 

X 


X  03  X 

se  " 

S  CH  -o 
Oh  83 
£  •  3 

°  ON  ^ 


cz 

G 

£ 


03 

3 

3 


OO 
On 

<*  _ 
T-H  3 

•  pH 

to 

►g  E-1 

3  z; 

•  ^ 

r  x  W 

U  x 
H  - 
Z 


03 

rS 

3 


3 

03 

H— * 

3 

3 


03 

H— > 

o 

3 

03 

3 

£ 

X 

03 

X 


03 

O 

3 

3 

£ 

Wh 

.0 


03  03 

X  X  X 

£  3  T3 

3  60  (U 

!:  -c  cir 
X  W  03 

S)  >r 

•C  £  H 

mC  ‘Z) 

^+-1  ^ 
C  c  3 


33  THH 

>  X 

es  g 
U  -2 

X  g 
J13 


X  O 


>  c2 

TH  03 

;L  X 
X  c/1 

£ 

3  *-> 

Oh 

£  ^ 

O  *—< 

0  X 
00  3 
NO  3 

oT  C« 

X  c 

03  O 
3  O 

>  C1- 

-2  S3 

3  ^ 

o  © 

X  5 

3  ^ 


g 

s 

■s 


X 

00 

H-H 

X 

X 

,-H 

>> 

T— H 

X 

>» 

03 

O 

X 

03 

3 

C3 

3 

3 

3 

3 

(-H 

3 

t-H 

s 

O 

t-H 

4-1 

<2 

t-H 

03 

t-H 

O- 

03 

Oh 

03 

X 

03 

3 

H 

3 

X 

03 

03 

3 

X 

3 

O 

o 

■*—» 

C3 


<2 
H— » 

Oh 

03 

O 

X 


3 


03 

<5 

J2 

00 

3 


03 
3 
X 

=*  8 
0  _o 

■M  A 


NTC96.  While  both  are  SIMITAR  test  brigades,  the  116th  Brigade  had  a  10-to-l  advantage  in  SIMITAR 
training  hours  over  the  48th  Brigade  in  2-3  years  of  training  before  their  NTC  rotations.  While  the 


NTC98  and  NTC96  performance  comparison  is  not  a  well-controlled  experiment,  we  know  of  no  factor 
that  invalidates  the  results  (see  Chapter  I.C). 

The  above  comparison  uses  an  external  baseline,  i.e.,  the  performance  of  other  Army  National 
Guard  (ARNG)  units  training  at  the  NTC,  to  benchmark  performance  of  the  116th  Brigade  at  NTC98. 
That  some  tasks  are  trained  by  SIMITAR  devices  and  courseware  while  other  tasks  are  not  gives  us 
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performance  data  and  SIMITAR  usage  data,  however,  do  not  enable  us  to  apportion  credit  between  the  two 
interventions. 


Compared  to  NTC96  benchmarks,  superior  performance  at  NTC98  is  attributed  to  the  amount  of 
SIMITAR  training — Janus  for  the  Brigade,  Armored  TF,  and  Support  Battalion  and  also  CSS  ICW  for  the 
Support  Battalion — that  differentiates  the  two  SIMITAR  test  brigades  at  NTC98  and  NTC96.  Comparison 
of  performance  on  SIMITAR  trained  tasks  with  performance  on  other  tasks  at  both  NTC98  and  NTC96 
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external  benchmark  of  training  performance  by  other  ARNG  (Army  National  Guard)  units  at  the  NTC. 
The  second  is  an  internal  baseline  in  which  performance  on  tasks  not  trained  by  SIMITAR  serve  as  a 
benchmark  for  the  performance  of  tasks  trained  by  SIMITAR. 


1 .  External  Benchmark 

Army  OCs  (observer-controllers)  provided  data  for  this  assessment  by  rating  task  performance  of 
the  116th  Armored  Cavalry  Brigade  at  the  NTC  in  July  1998.  The  NTC98  performance  is  compared  to 
performance  by  the  48th  Mechanized  Infantry  Brigade  at  NTC  in  June  1996.  These  eSBs  (enhanced 
Separate  Brigades)  of  the  ARNG  are  SIMITAR  test  brigades  that  differ  markedly  in  the  amount  of 
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task  performance  grading  was  done  by  OCs  at  NTC98,  OCs  graded  performance  of  only  the  Mechanized 
Infantry  Task  Force  at  NTC96.  SIMITAR  project  personnel — all  with  substantial  Active  Army  experience 
in  combat  arms — graded  NTC96  task  performance  by  the  Brigade  HQ  and  the  Armored  Task  Force;  these 


SIMITAR  project  observers  accompanied  OCs  in  the  field  day  and  night  throughout  the  entire  training 
exercise. 

In  summary,  comparison  of  NTC98  and  NTC96  performances  is  not  a  controlled  experiment; 
however,  none  of  the  foregoing  unmeasured  variables  appears  to  undermine  the  credibility  of  this 
performance  comparison.  Thus,  we  believe  that  observed  differences  between  performances  at  NTC98 
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Tank  Gunner  Course _ Abrams  Tank  Gunner's  Course _ 

Triage _ Voice-Operated  Medical  Triage  Trainer 

VMAT _ Virtual  Reality  Maintenance  Trainer 


Table  1-2.  SIMITAR  Interventions:  Functional  Descriptions 

AFIST  Improvements  to  an  existing  low-cost,  transportable  multimedia  tank  gunnery  simulator  that 

_ is  attached  to  a  stationary  tank  located  in  a  training  area. _ 

AR  SI  Reconfigurable  simulation  platform  capable  of  emulating  Abrams  and  Bradley  armored 

_ vehicles  and  High  Mobility  Multipurpose  Wheeled  Vehicles  (HMMWVs). 
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Table  1-2.  SIMITAR  Interventions:  Functional  Descriptions  (Continued) 

Janus  (Bde  and  Bn)  Enhancements  to  the  Janus  system  significantly  reduce  its  cost,  add  CS  and  CSS 

_ functions,  and  provide  distributed  interactive  simulation  (PIS)  capabilities. _ 

Mobile  SIMNET  Existing  mobile  simulator  for  training  company  and  platoon  maneuver.  Enhancements 

_ allow  it  to  be  used  on  long-haul  network  for  executing  battalion  and  brigade  exercises. 
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SIMITAR  Program  personnel  selected  priority  CCFs  by  (1)  reviewing  various  Persian  Gulf  War  after  action  reports; 
(2)  analyzing  research  reports;  (3)  interviewing  personnel  involved  in  mobilization  and  training  of  Roundout  brigades;  and 
(4)  holding  discussions  with  other  relevant  groups  (Ref.  2). 
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We  used  linear  and  nonlinear  methods  to  analyze  the  regression  of  NTC  task  performance  on  the 
SIMITAR  units  tested  at  the  NTC;  these  units  are  a  surrogate  for  amount  of  SIMITAR  training.  In  the 


linear  method,  we  assigned  values  of  2,  1,  and  0  to  ratings  of  Trained  (T),  Needs  Practice  (P),  and 
Untrained  (U),  respectively.  The  linear  method  assumes  the  dependent  variable,  task  performance,  is 
measured  on  a  linear  scale;  the  linear  scoring  method  involves  a  linear  regression  analysis  to  develop  a 
least  square  line  for  predicting  NTC  performance.  The  OC  rating,  however,  is  a  discrete  variable 
representing  only  ordinal  relationships;  this  simple  linear  scale  may  not  reflect  the  actual  mathematical 
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The  computer-based  regression  programs,  which  are  limited  dependent  variable  models,  are  contained  in  Ref.  4.  Application 
and  discussion  of  Ordered  Probit  and  Ordered  Logit  are  contained  in  Refs.  5  and  6. 
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Table  11-3.  Number  and  Percent  of  Tasks  Trainable  by  SIMITAR  Interventions 

_ Battlefield  Operating  Systems _ 
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Does  not  train  brigade-  and  battalion-level  tasks  in  Fire  Support;  trains  only  one  task  (Call  for  Fire)  at  lower  echelons. 
Last  row  indicates  number  and  percent  of  tasks  that  are  trainable  by  one  or  more  interventions. 


Platoon-Janus 
SIMNET  (Abrams) 

SIMNET  (Bradley) 

Last  row  indicates  number  and  percent  of  tasks  that  are  trainable 
by  one  or  more  interventions. 


Table  11-5.  Example  Portion  of  Task  Performance  Matrix 


III.  ANALYSIS  AND  RESULTS 
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different  for  the  Mech  Infantry  TFs,  where  NTC96  performance  on  SIMITAR  trainable  tasks 
significantly  better  than  NTC98  performance. 


Table  III-3  shows  performance  scores  on  tasks  trained  by  SIMITAR  and  tasks  not  trained  by 
SIMITAR  for  the  Brigades  and  Armored  and  Mech  Inf  (Mechanized  Infantry)  TFs  at  both  NTC98  and 
NTC96.  The  table  shows  average  scores  and  the  results  of  t  tests  for  independent  samples.  We  performed 
these  statistical  analyses  to  determine  whether  the  differences  in  average  performance  on  SIMITAR-trained 
versus  not-SIMITAR-trained  tasks  were  significant  (i.e.,  not  due  to  chance).  We  tested  the  hypothesis 
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performed  significantly  better  on  SIMITAR-trained  tasks  than  on  tasks  not  trained  by  SIMITAR.  At 
NTC96  the  Brigade  performance  was  better,  but  not  significantly,  on  SIMITAR-trained  tasks.  The 
average  scores  on  SIMITAR-trained  and  not-trained  tasks  were  about  equal  for  the  Armored  TF  at  NTC96 


(0.63  and  0.66)  and  the  Mech  Inf  TF  at  NTC98  (0.63  and  0.65).  A  discussion  of  the  validity  of  this 
within-unit  analysis  is  repeated  from  our  earlier  SIMITAR  Assessment  report  (Ref.  1)  in  Appendix  B. 

Table  III-4  shows  linear-regression-derived  performance  by  echelon  at  NTC98  and  NTC96. 
Performance  in  both  rotations  was  best  at  the  platoon  level  and  progressively  declined  at  higher  echelons. 
Mean  scores  were  better  at  all  echelons  at  NTC98.  Battalion-level  tasks  in  the  table  are  all  Armored  TF 
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trained — by  SIMNET  (Abrams)  for  tank  platoons  and  ARSI  and  P-Janus4  for  BFV  platoons — while  others 


were  not.  Using  our  within-unit  baseline  for  assessing  SIMITAR,  we  show  in  Table  III-7  that  tank 
platoons  scored  slightly  better  (1.12  vs.  1.06),  but  not  significantly  better  statistically,  on  tasks  not  trained 
by  SIMNET  (Abrams)  than  on  tasks  trained  by  SIMNET  (Abrams).  The  BFV  platoons  scored  signifi¬ 
cantly  better  (0.95  vs.  0.70)  on  tasks  trained  by  ARSI  and  P-Janus  than  on  tasks  not  trained  by  SIMITAR. 

Table  III-8  also  compares  performance  within  the  116th  Brigade.  Both  linear  and  nonlinear 
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performance  in  only  the  Fire  Support  and  Air  Defense  BOSs,  unlike  Brigade  and  Armored  TF 
performance.  Mech  Infantry  TF  performance  at  NTC96  is  significantly  better  than  NTC98  performance 
in  four  BOSs — Maneuver,  C2,  Mobility  and  Survivability,  and  CSS. 


3.  One  Intervention  Used 

Before  attempting  to  explain  the  inferior  NTC98  SIMITAR  performance  of  the  Mech  Infantry  TF  in 
comparison  to  performances  by  the  Brigade  and  Armored  TF,  we  need  to  identify  those  SIMITAR 
interventions  that  were  actually  used  by  the  116th  Brigade  to  train  tasks  from  the  set  of  interventions  that 
are  capable  of  training  tasks.  This  identification  process  was  applied  to  Brigade  and  both  TFs  for  all  seven 
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Infantry  TF  was  notably  smaller  (8  to  4). 


Table  HI- 14  shows  that  both  the  Brigade  staff  and  the  Armored  TF  performed  significantly  better  at 
NTC98  than  their  counterparts  at  NTC96.  The  last  column  identifies  Janus  as  the  SIMITAR  intervention 
that  we  infer  was  responsible  across  all  BOSs  for  the  superior  training  performance. 

Training  in  CSS  for  the  staffs  of  the  Brigade  HQ  and  both  TFs  included  (1)  three  full  CSS  Janus 
exercises  in  the  year  and  a  half  prior  to  NTC98  and  (2)  limited  CSS  in  other  Janus  exercises.5  In  our 
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Limited  CSS  Janus  exercises  involve  emulation  of  expenditure  and  replenishment  of  fuel  and  ammunition.  Besides 
accounting  for  fuel  and  ammunition,  full  CSS  Janus  exercises  involve  emulating  (1)  use  of  medical  personnel  and  vehicles  to 
evacuate  casualties  and  (2)  use  of  personnel  and  material  resources  to  assess  battle  damage  and  to  replace  components, 
requisition  parts,  and  track  the  maintenance  effort  to  make  repairs. 


in  May  98. 6  Among  them,  these  six  staff  members  missed  over  two-thirds  of  the  1-163  Battalion/TF  Janus 
training.  The  baseline  Mech  Infantry  TF  at  NTC96  is  reported  to  have  had  no  battle  staff  changes 
throughout  four  Janus  exercises  over  a  2-year  period  prior  to  NTC.7  The  performance  results  in 
Table  III- 15  indicate  that,  without  the  Janus  advantage,  the  Mech  Infantry  TF  at  NTC98  was  significantly 
superior  to  its  NTC96  counterpart  in  only  the  Fire  Support  and  Air  Defense  BOSs;  and  the  Mech  Infantry 
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From  1-163  Bn  records  (Ref.  7). 

As  recollected  by  an  officer  who  served  with  the  48th  Brigade  during  the  early  1990’s  and  at  NTC96  (Ref.  8). 
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regression  method  cannot  be  used.  Some  details  of  the  linear  regression  results  are  shown  in  Table  III- 17. 
Comparative  usage  of  Janus  and  CSS  ICW  and  comparative  NTC  performance  indicate  these  SIMITAR 
interventions  are  responsible  for  the  superior  performance  of  the  NTC98  Support  Battalion.  We  are  not 
able  to  apportion  credit  between  the  two  interventions. 


Table  111-1.  Brigade  Staff  Performance3 

(See  Appendix  A,  Table  A-1,  for  more  details) 
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Table  111-2.  Task  Force  Performance3 

(See  Appendix  A,  Table  A-2,  for  more  details) 
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Table  111-3.  Brigade  and  Task  Force  Performance3  at  NTC98  and  NTC96 
on  Tasks  Trained  and  Not  Trained  by  SIMITAR 

{See  Appendix  A,  Table  A-3,  for  more  details) 
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Table  111-4.  NTC  Performance3  by  Echelon 
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Most  observed  tasks  (45  of  47)  were  performed  by  Scout  and  Mortar  platoons. 


Table  111-5.  NTC  Performance3  on  SIMITAR  Trainable  Tasks  by  Echelon 

(See  Appendix  A,  Table  A-4,  for  more  details) 


were  performed  by  Scout  and  Mortar  platoons. 


Table  111-6.  Tank  and  BFV  Platoon  Performance3  at  NTC98 
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Table  111-8.  Tank  and  BFV  Platoon  Performance3  on  SIMITAR  Trainable  Tasks 

at  NTC98  and  AT97 

(See  Appendix  A,  Table  A-6,  for  more  details) 


ffl- 16 


Table  111-9.  Brigade  Performance3  on  SIMITAR  Trainable  Tasks  by 
Battlefield  Operating  System  (BOS) 

(See  Appendix  A,  Table  A-7,  for  more  details) 


result  would  occur  by  chance. 

Nonlinear  inestimable  due  to  zero  variance  in  one  group. 


Table  111-10.  Armored  Task  Force  Performance3  on  SIMITAR  Trainable  Tasks  by 

Battlefield  Operating  System  (BOS) 

(See  Appendix  A,  Table  A-8,  for  more  details) 


result  would  occur  by  chance. 

Nonlinear  inestimable  due  to  zero  variance  in  one  group. 


Table  111-11.  Mech  Infantry  Task  Force  Performance3  on  SIMITAR 
Trainable  Tasks  by  Battlefield  Operating  System  (BOS) 

(See  Appendix  A,  Table  A-9,  for  more  details) 


result  would  occur  by  chance. 

Nonlinear  inestimable  due  to  zero  variance  in  one  group. 


Table  111-12.  SIMITAR  Interventions  That  Were  Used  by  the 
116th  Brigade’s  Armored  TF  for  Maneuver  Task  Training 
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Table  111-13.  Number  of  Janus  Exercises  in  Pre-NTC  Training 
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15.  Superior  NTC  Performance3  by  Mechanized  Infantry  TFs 


III-23 


Table  111-16.  Support  Battalion  Performance3  on 
SIMITAR  Trainable  Tasks  by  BOS 
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Table  111-17.  Comparison  of  Support  Battalion  Performance  at 
NTC98  and  NTC96  by  Linear  Regression  Method 
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counterparts  at  NTC96.  The  three  elements— Brigade  HQ,  Armored  TF,  and  Support  Battalion— that  had 
markedly  more  pre-NTC  Janus  training  (all  three  elements)  and  CSS  ICW  training  (the  Support  Battalion) 
performed  significantly  better  than  the  counterpart  elements  at  NTC96  (see  Tables  III- 14  and  III- 16).  The 
NTC98  Mech  Infantry  TF,  whose  nominal  advantage  in  Janus  training  was  nullified  by  numerous  battle 


staff  changes,  performed  significantly  better  in  two  BOSs  and  significantly  worse  in  four  BOSs  than  the 
NTC96  Mech  Infantry  TF,  which,  because  of  the  other’s  staff  changes,  may  have  had  an  advantage  in  Janus 
training  (see  Table  III- 15). 

In  every  case  in  which  we  used  within-unit  baselines,  average  performance  at  NTC98 — and  NTC96 
also — on  SIMITAR-trained  tasks  was  about  equal  to  or  significantly  better  than  on  tasks  not  trained  by 
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improved  with  exposure  to  SIMITAR  training  devices,  courseware,  and  strategies.  Whether  we  use 
external  or  internal  performance  benchmarks,  our  evaluations  consistently  confirmed  the  effectiveness  of 
SIMITAR  interventions. 
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Telephone  conversations  with  Major  A1  Fracker,  U.S.  Army  Infantry  School,  Fort  Benning,  GA. 
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NTC  National  Training  Center 

OC  observer  controller 

OPFOR  opposing  force 

P  Needs  Practice  or  percentage 
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Table  A-1.  Comparison  of  Brigade  Performance  Between  NTC98  and  NTC96 
by  Linear  and  Nonlinear  Regression  Methods 


A-3 


Table  A-2.  Comparison  of  Task  Force  Performance  Between  NTC98  and  NTC96 

by  Linear  and  Nonlinear  Regression  Methods 
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Table  A-3.  Comparison  of  Brigade  and  Task  Force  Performance  at  NTC98  and  NTC96 
Between  SIMITAR  Trainable  and  Nontrainable  Tasks  by  Linear 
and  Nonlinear  Regression  Methods 


p  is  the  probability  in  two-tailed  test  of  significance  that  NTC98  performance  and  NTC96  performance  are 
equal  and  the  observed  difference  is  due  to  chance. 


Table  A-4.  Comparison  of  Performance  by  Echelon  Between  NTC98  and  NTC96  on  SIMITAR 
Trainable  Tasks  by  Linear  and  Nonlinear  Regression  Methods 
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Table  A-5.  Comparison  of  Performance  at  NTC98  on  Tank  and  BFV  Platoon  Tasks  Between 
SIMITAR  Trainable  and  Nontrainable  Tasks  by  Linear  and  Nonlinear  Regression  Methods 
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Table  A-6.  Comparison  of  Tank  and  BFV  Platoon  Performance  Between  NTC98  and  AT97  on 
SIMITAR  Trainable  Tasks  by  Linear  and  Nonlinear  Regression  Methods 
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Table  A-7.  Comparison  of  Brigade  Performance  by  BOS  Between  NTC98  and  NTC96  on 
SIMITAR  Trainable  Tasks  by  Linear  and  Nonlinear  Regression  Methods 
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Table  A-8.  Comparison  of  Armored  Task  Force  Performance  by  BOS  Between  NTC98  and 
NTC96  on  SIMITAR  Trainable  Tasks  by  Linear  and  Nonlinear  Regression  Methods 


Nonlinear  solutions  are  inestimable  due  to  zero  variance  in  one  group. 


Table  A-9.  Comparison  of  Mech  Infantry  Task  Force  Performance  by  BOS  Between  NTC98  and 
NTC96  on  SIMITAR  Trainable  Tasks  by  Linear  and  Nonlinear  Regression  Methods 


Nonlinear  solutions  are  inestimable  due  to  zero  variance  in  one  group. 
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APPENDIX  B 

Validity  of  Analysis  of  Tasks  Trained  and  Not  Trained  by 
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This  discussion  pertains  to  analysis  of  training  performance  by  units  of  the  48th  Mechanized  Infantry  Brigade  at  the  National  Training  Center  in 
1996  (Orlansky,  J.,  J.  Metzko,  J.  Morrison,  and  G.  Picked,  Assessment  of  SIMITAR:  Status  Report  One,  Institute  for  Defense  Analyses,  IDA 
Document  D-2069,  April  1997). 


tasks.  In  other  words,  the  lack  of  differences  in  the  other  two  brigade  elements  argues  against  this  source 
of  confounding  and  in  favor  of  the  conclusion  that  SIMITAR  training  improves  NTC  task  performance. 
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